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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] this invention relates to the multi-eye picture sensor which picturiz 
simultaneously two or more pictures from which the view for the stereo image processing system which measures th 
distance to an object object etc. differs using the principle of triangulation from the picture which is acquired by two 
or more picture sensors arranged in a different position and from which two or more views differ. 
[0002] 

[Description of the Prior Art] Human being has acquired a cubic effect with the parallax produced among right-and- 
left both eyes. Stereo ** (called a stereo vision, stereo stereoscopic vision, etc.) is the technique of processing this 
visual sense with two cameras. The multi-eye picture sensor of this invention is a picture sensor for acquiring 
simultaneously two or more pictures from which the view from two or more picture sensors differs which is needed 
when extending this stereo ** to many eyes and performing it. Below, first, the principle of stereo **, the procedure 
of a multi-eye stereo, etc. are described briefly, and it explains how the conventional multi-eye picture sensor consis 
of after that. 

[0003] Drawing 11 shows the principle of the distance measurement by stereo of two eyes. In order to simplify 
search of correspondence in the case of photography for measurement, the picture sensor (it may only be hereafter 
described as a camera) on either side shall be installed so that a horizontal axis and an optical axis (Optical axes) ma 
become respectively parallel by right and left. At this time, the point P on the object front face in 3-dimensional spa 
(x y, z) is the distance F (projected on Point PL (xl and yl) and Point PR (xr and yr) on the image plane of two sheet 
in the position of a focal distance (focal length).) from the focus (focal point) (OL and OR) of a camera lens. If the 
focal distance F and the base length (base line) B of a camera (distance between cameras) are known at this time, it 
can ask for the space coordinates of the point P on an object front face (x y, z) from the principle of triangulation 
shown in the following formula (1) by asking for the correspondence relation between the point PL on an image pla 
(xl and yl), and Point PR (xr and yr). 
[0004] 
[Equation 1] 
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[0005] Here, since it is easy, only the distance z to an object object is considered. Since the camera is arranged in 
parallel with right and left, each point shifts in the direction of a x axis on an image plane. It is d=xl-xr in 
corresponding gap (xl-xr) of a point, i.e., parallax. Distance Z is Z=BF/d when expressed. -- It becomes a formula (2 

[0006] Stereo ** is passive distance mensuration which does not use laser, an electric wave, an acoustic wave, etc. 
Therefore, even if it is safe for people's eyes and employs more than one simultaneously, there is no interference an 
other measurement is not affected. Moreover, in order that the exposure time of image pck-up elements, such as CC 
(Charge Coupled Device) used for a camera, may not have early a mechanical scanner like the usual laser range 
finder which measures distance by laser so that it can usually be disregarded, it is simple for the structure of a senso 



and has the advantage of the image flow under movement not occurring. Although a laser range finder can measure 
precise one-point distance of one point, it is expensive and processing speed is also comparatively slow. From such 
situation, a camera consists of solid state image pickup devices, such as CCD, small, and stereo ** which used the 
camera is often used for obstruction recognition of a robot etc. from it recently. 

[0007] If corresponding points can be found and parallax is known, the distance (depth) from a formula (2) to an 
object object is calculable. Therefore, it can be said that how the corresponding points of the picture between earner 
can be extracted correctly has processing of stereo **. For example, the improvement methods of various stereo **, 
such as the amendment method, are studied in dispersion in the method of paying one's attention to the high order 
features, such as the method of narrowing down corresponding points hierarchical conventionally, a way the DP 
extracts corresponding points, a field, and a curve, lighting, etc. However, the result corresponding to it was not 
necessarily obtained to processing being complicated by these devices. The method of asking for corresponding 
points correctly is recognized as a more practical method by avoiding complication of processing and increasing the 
amount of information which can be simply used using two or more cameras recently. 
[0008] The method of performing stereo ** using these two or more cameras is called "multi-eye stereo." In 
processing of stereo **, if the picture coordinate of the picture which measures distance was decided, the distance o 
the point was assumed and arrangement of a camera was decided, it can be reflected by the image plane of other 
cameras where, or can investigate in advance. In processing of a multi-eye stereo, the point of changing the distance 
to assume and being reflected with each camera is investigated, and all cameras extract the synthetic probable 
corresponding points. 

[0009] Drawing 12 shows the theoretic view of a multi-eye stereo. Like drawing 12 , two or more cameras shall be 
arranged horizontally. And suppose that an object (they are vehicles and a tree in this drawing) is in front of two or 
more of these cameras. This object is reflected although the positions which come out differ to each camera. For 
example, the position to which an object is reflected visits the left-hand side of a screen as the position of a camera 
will move to the right, if based on the picture of the camera at the leftmost. A long distance thing has few amounts o 
this gap, and a nearby thing shifts greatly. If the distance Z to an object object is assumed to the picture coordinate i 
it (I, J) by making the picture of a left camera into a criteria picture, the coordinate (here, it will be called a 
correspondence candidate point) of the body reflected with other cameras can be determined in advance from the 
arrangement relation of a camera. The same thing as the coordinate of the oak which is looking at the same object 
object, and the body assumed by the picture of each camera should be reflected. 

[0010] Therefore, if the degree of similar of the lightness (lightness of a correspondence candidate point group) of th 
coordinate of these bodies is investigated, it can investigate whether a body is in the actually assumed distance Z. Th 
distance Z to assume can be changed serially, and the degree of similar of a correspondence candidate group can be 
investigated, and let assumption distance Z with the highest degree of similar be the estimate of the distance to a 
body. Here, although the camera has been arranged horizontally, if the coordinate of a correspondence candidate po 
can calculate beforehand, distance can be presumed also by the case of camera arrangement of a perpendicular or 
arbitrary sense. 

[001 1] Since the information on two or more cameras is united and a multi-eye stereo estimates correspondence, the 
right corresponding points can be extracted more exactly. For example, a camera is arranged horizontally and 
presupposes that the object of a level edge is seen. In this case, since the direction of the parallax between cameras i 
the same horizontal direction as the direction of an edge, it moved where or cannot ask for the position correctly. On 
the contrary, if a camera is arranged perpendicularly, since parallax will be produced in the form which intersects 
perpendicularly with the direction of an edge, it is easily detectable where it shifted. If the camera arranged 
perpendicularly is used to a level edge, detection of corresponding points will become exact. Moreover, the 
combination of the camera horizontally arranged to a perpendicular edge is good. 

[0012] From this, if two or more cameras are arranged, it can be well coped with also by the case of various edges o 
a configuration. For example, what a center is used as a criteria camera and arranges nine sets and a camera in the 
shape of [ of 3x3 ] a grid can be performed. Thus, in a multi-eye stereo, two or more cameras are only used for 
evaluation of correspondence, and extraction of stout corresponding points is attained with a comparatively easy 
algorithm. 

[0013] It becomes a flow when the procedure of parallax calculation of a multi-eye stereo is written somewhat 
concretely, as shows it to drawing 13 . Here, processing of a multi-eye stereo is explained in detail using drawing 13 
Although how many sets are sufficient as the number of a picture sensor (camera), it is nine sets (camera) of picture 
sensors as an example here, and the case where the object object is being picturized simultaneously is considered. 
Moreover, in order to perform search of actual corresponding points on a picture side, it searches for corresponding 
points so that parallax d may be assumed on each point and it may become at equal intervals mostly on a picture sid 
instead of the distance Z which is the depth in 3-dimensionaI space. With combination of a camera, the size and 



direction of parallax which are actually produced on an image plane change. Therefore, suppose that the parallax it 
decided among any other one set that will be a main criteria camera is defined as parallax d at a standard here. 
[0014] In addition, Distance Z and parallax d are connected by the formula (2). As for nine cameras, the 
synchronization shall be taken with one synchronizing signal. A video signal (since there is also a case of a digital 
camera, you may be a digital signal at this time) is usually outputted by the raster scan from each camera. A/D 
conversion (it is unnecessary when an input is a digital signal) of each video signal is carried out, and it is recorded 
the picture buffer of each camera. The following processings are started after the whole picture of each camera is 
inputted into a picture buffer. 

[0015] First, candidate value di of the picture coordinate for calculation (I, J), and parallax It specifies and the 
lightness information on a correspondence candidate point is taken out from the picture buffer of each camera. 
Candidate value di of the parallax in the picture coordinate (I, J) which it specified when the degree of similar of the 
lightness of these correspondence candidate point groups was calculated It becomes a probability. Usually, when 
calculating this degree of similar, the situation of correspondence near the picture coordinate (I, J) is also taken into 
consideration and calculated. Serially, it is the candidate value di of parallax. It can change and the probable paralla 
can be searched for. Moreover, the parallax about a full screen, i.e., a parallax picture, can be calculated by changin 
a picture coordinate (I, J) for this processing per 1 pixel. The parallax each point was presumed to be is easy 
calculation, and can be changed into the value of-like 3-dimensional depth. 

[0016] As mentioned above, although the principle and procedure of a multi-eye stereo were explained, there is a 
point which it should be careful of by actual processing of a multi-eye stereo. It is a correspondence candidate point 
coming out with each camera where, or calculating and extracting the coordinate correctly. It is necessary to conside 
distortion of the lens of a camera, gap of the timing of A/D conversion, and gap of installation of a camera, and to a 
for the position to which it is actually reflected correctly. For this reason, it is necessary to measure distortion of a 
camera, gap of installation, etc. correctly, and to grasp them as a premise of processing of a multi-eye stereo, for 
every multi-eye picture sensor to be used. At once, again, even if it measures, it is influential with change of a 
mechanical bundle condition of the screw of installation of a shock and a lens to the extent that it is necessary to 
remeasure. 

[0017] Although two or more pictures from which a view differs are needed in a multi-eye stereo, these pictures are 
the same time and it is necessary to photo them with the camera of the same kind. And as long as the almost same 
object is contained in a picture and views differ, you may take a photograph by what method. However, as it said 
previously that the physical relationship between cameras is not being fixed, in case measurement for coordinate 
calculation of a correspondence candidate point is not performed to whenever [ the ], a multi-eye picture sensor is 
needed the camera head of the exclusive use which fixed two or more cameras, and here. 

[0018] Although the picture sensor (camera) used for a multi-eye picture sensor needs to take a synchronization in 
order to make the timing of an image pck-up in agreement, what camera may be used for it as long as it can fix 
arrangement of a camera. Conventionally, there is nothing that is marketed as a picture input sensor of exclusive use 
for multi-eye stereo processing. Therefore, a multi-eye picture sensor will be made, combining the usual camera two 
or more. 

[0019] Drawing 14 shows intelligibly the example of composition of the conventional multi-eye picture sensor by th 
conceptual diagram. Each camera 16 consists of members 4 which fix the member 2 which fixes an optical lens 1 an 
an optical lens, an image pck-up element, the circumference electronic circuitry 3, an image pck-up element, etc. If 
two or more cameras 16 are attached in the camera holddown member 6, it will become a multi-eye picture sensor. 
The feature of the conventional multi-eye picture sensor is that each camera 16 "has been independent", respectively 
and it is fixing them by a certain holddown member. In addition, drawing 14 is what emphasized the independence 
each camera and was shown by the conceptual diagram, and parts which are not essential to explanation here, such 
an installation mechanism, a screw, etc. of each part article which are needed with the configuration of a camera etc 
are excluded. 

[0020] Although drawing 14 showed the example of composition showing the feature of the conventional multi-eye 
picture sensor, when it constitutes an actual multi-eye picture sensor, it can make from various forms. The example 
composition of the concrete conventional multi-eye picture sensor is shown in drawing 15 and drawing 16 . Drawin 
15 constitutes the multi-eye picture sensor of nine eyes using the camera of the usual core box. Fixing metal 17 is 
attached in a form as shown in some cameras 16 18. Nine cameras carried out in this way were prepared, and it has 
attached in the camera holddown member 6.~ 

[0021] Drawing 16 is the example which used the card type camera module and constituted the multi-eye picture 
sensor of nine eyes. It is miniaturized from the camera of the enclosed type of 16, and this card type camera module 
19 is often used recently. Each card type camera module 19 consists of members 4 which fix the member 2 which 
fixes an optical lens 1 and an optical lens, an image pck-up element, the circumference electronic circuitry 3, an 



image pck-up element, etc., as shown in drawing 16 . An optical lens 1 is attached in the member 2 which fixes an 
optical lens, and is fixed to the member 4 which fixes an image pck-up element etc. with a screw etc. Two or more 
card type camera modules 19 are fixed to the camera holddown member 6 with a screw etc., and a multi-eye picture 
sensor is constituted. As the conceptual diagram of drawing 14 showed, it consists of ways of fixing arrangement 
between cameras also by drawing 15 and the multi-eye picture sensor of drawing 16 using the camera (or camera 
module) which became independent one by one. 
[0022] 

[Problem(s) to be Solved by the Invention] As mentioned above, the multi-eye picture sensor used for the 
conventional multi-eye stereo processing was what only packs two or more usual picture sensors, and constitutes 
them. However, since the usual picture sensor is not made from the premise of using two or more picture sensors 
simultaneously, if it is going to multi-eye-picture-sensor-realization-make it easy to be actually small and to use, 
various troubles will generate it. this invention tends to solve the technical problem enumerated below. 
[0023] (1) The installation space of a lens is required and the whole equipment becomes large. When the usual pictu 
sensor is used, one lens is used to each picture sensor. For this reason, an installation screw and a mechanism are 
needed for every lens. The space of installation of a lens is required for each of, and when two or more picture senso 
are packed, it becomes difficult for the space of installation of this lens to occupy a big portion as a whole, and to 
miniaturize a multi-eye picture sensor as a result. 

[0024] (2) Installation takes time and effort and adjustment is serious. When it constitutes a multi-eye picture sensor 
using the usual picture sensor, the lens of each picture sensor is divided individually and it takes the time and effort 
installation as a whole. Especially, the geometry of an image pck-up of a picture may shift delicately in the bundle 
condition of the screw of installation of a lens. This gap influences the precision of coordinate calculation of the 
correspondence candidate point of processing of a multi-eye stereo, and also affects the processing result of a multi- 
eye stereo. Possibility of shifting even if the part adjusted since the lens has been independent individually adjusts b 
many [ and ] mechanical vibration becomes high. 

[0025] (3) The price of equipment is high in order to use two or more image pck-up elements. When a multi-eye 
picture sensor is constituted combining the usual picture sensor, two or more image pck-up elements will surely be 
used, and a picture sensor will also use the digital disposal circuit of the circumference of it by the number. For this 
reason, not only a miniaturization is difficult, but as compared with one set of the usual picture sensor, the price of a 
multi-eye picture sensor becomes high. 
[0026] 

[Means for Solving the Problem] Then, invention according to claim 1 is set in the multi-eye picture sensor which 
picturizes simultaneously two or more pictures from which the view for acquiring the input picture of the stereo 
image processing which acquires the distance information to an object object etc. by the principle of tri angulation, 
and two or more becoming pictures differs. Two or more optical lenses by which the lens was fixed in the tubed cas 
where it has the screw section into a periphery portion, The lens holddown member for two or more through holes 
which have the screw section in which the screw section of the aforementioned case is screwed being formed, and 
carrying out positioning fixation of two or more aforementioned optical lenses removable, It has the holddown 
member which is located on each optical axis of two or more aforementioned optical lenses by which positioning 
fixation is carried out and by which two or more picture image pck-up elements were fixed to two or more 
aforementioned through holes. By making the aforementioned picture image pck-up element which corresponds 
through two or more aforementioned optical lenses receive the light from the external world, it is characterized by 
picturizing two or more pictures from which the view which is needed for the aforementioned stereo image 
processing differs. 

[0027] In the multi-eye picture sensor which picturizes simultaneously two or more pictures from which the view fo 
invention according to claim 2 acquiring the input picture of the stereo image processing which acquires the distanc 
information to an object object etc. by the principle of tri angulation, and two or more becoming pictures differs It ha 
the lens holddown member in which the lens by two or more pinholes was formed, and the holddown member to 
which it was located on each optical axis of two or more lenses twisted at the aforementioned pinhole, and two or 
more picture image pck-up elements were fixed. By making the aforementioned picture image pck-up element whic 
corresponds through two or more lenses which depend the light from the external world on the aforementioned 
pinhole receive light, it is characterized by picturizing two or more pictures from which the view which is needed fo 
the aforementioned stereo image processing differs. 

[0028] In the multi-eye picture sensor which picturizes simultaneously two or more pictures from which the view fo 
invention according to claim 3 acquiring the input picture of the stereo image processing which acquires the distanc 
information to an object object etc. by the principle of tri angulation, and two or more becoming pictures differs The 
lens holddown member which has the light-transmission nature in which two or more Fresnel lenses were formed, B 



having the holddown member to which it was located on each optical axis of two or more aforementioned Fresnel 
lenses, and two or more picture image pck-up elements were fixed, and making the aforementioned picture image 
pck-up element which corresponds' through two or more aforementioned Fresnel lenses receive the light from the 
external world It is characterized by picturizing two or more pictures from which the view which is needed for the 
aforementioned stereo image processing differs. 

[0029] Invention according to claim 4 is characterized by making the portion except the aforementioned Fresnel len 
of the aforementioned lens holddown member into light impermeability in the multi-eye picture sensor of a claim 3 . 
[0030] Invention according to claim 5 is characterized by having one picture image pck-up element which has the 
image pck-up side which receives all the pictures from two or more aforementioned lenses in one multi-eye picture 
sensor of the claims 1-4. 

[0031] In one multi-eye picture sensor of the claims 1-5, invention according to claim 6 is arranged between two or 
more aforementioned lenses and the aforementioned picture image pck-up element, and is characterized by having t 
shield which makes the picture from two or more aforementioned lenses receive, respectively so that it may be settle 
in the image pck-up side of the predetermined field on the optical axis of each lens. 

[0032] When it constitutes a multi-eye picture sensor, two or more optical lenses (a compound lens is included) can 
be easily attached with easy structure by using the lens holddown member which consists of one member in inventio 
according to claim 1. Since it is unified by one member, it not only can replace two or more lens fittings which were 
need conventionally with one parts, but it can lessen splicing-machine styles, such as a screw hole for installation, a 
especially the lens holddown member of this invention can be contributed to the miniaturization as parts. 
[0033] Moreover, although the multi-eye picture sensor in invention according to claim 2 of the composition and th 
basic target of invention according to claim 1 is the same, a lens or a compound lens is not used but it is made to 
achieve the function of a lens at a pinhole. Therefore, in order not to use an expensive lens or an expensive compou 
lens, further, part mark are cut down, and it is cheap, processing is easy and it becomes possible to constitute a 
smaller multi-eye picture sensor. 

[0034] Furthermore, by the multi-eye picture sensor in invention according to claim 3, not the pinhole used with the 
composition of invention according to claim 2 but the lens holddown member of light-transmission nature itself is 
processed like a Fresnel lens, and the function of a lens can be achieved. 

[0035] If a portion predetermined by the paint and member which do not make light penetrate is covered in the lens 
holddown member of light-transmission nature like the multi-eye picture sensor in invention according to claim 4, t 
influence and interference of an excessive light whose intention it does not have as a picture sensor can be lessened, 
and only a required place can be operated as an optical lens. 

[0036] If it is the composition of the multi-eye picture sensor in invention according to claim 5, the picture of the 
view from which the plurality which is needed for a stereo image processing differs with one picture image pck-up 
element can be picturized simultaneously. 

[0037] The influence and interference beyond the image pck-up field of an excessive light which are not meant can 
lessened in the image pck-up field in which the image pck-up side of one picture image pck-up element was classifi 
by using the shield which does not make light penetrate like the multi-eye picture sensor in invention according to 
claim 6. 

[0038] Hereafter, the advantage, the feature, and detail of others of this invention are clarified, referring to an 

accompanying drawing based on explanation of the form of desirable operation of this invention. 

[0039] 

[Embodiments of the Invention] (Form 1 of operation) Here, by using the lens fittings in invention according to clai 
1 which consist of one member describes the form of the operation which attaches two or more lens or two or more 
compound lenses with easy structure. Here, since it is easy, expression called an optical lens also only shows a 
compound lens. If expressed with easy composition, I hear that attaching an optical lens by one member takes 
composition like drawing I , and there is. The optical lens 1 is being fixed by the member 2 which fixes one optical 
lens. Since it is easy, in this drawing, parts, such as an actually required screw for connection of parts, and a 
mechanism, a spacer, have been omitted. 

[0040] Drawing 3 and drawing 4 make composition of drawing 1 a more concrete form. Here, although 
************ j num b er 0 f optical lenses / how many ] (two or more pieces), nine cases are shown as an examp 
This is the same also with the form of other operations. Drawing 3 shows the appearance of the multi-eye picture 
sensor which fixed two or more optical lenses 1 by one member 2. Drawing 4 is expressed with the form which the 
multi-eye picture sensor of drawing 3 is constituted how, or is decomposed. Positioning fixation of the lens lb was 
carried out into case la tubed in each optical lens 1, and screw section lc is formed in a part of peripheral face of ca 
la. 

[0041] Each optical lens 1 is the form with which the usual camera mounting is equipped, and is attached removable 



to the rectangle-like lens holddown member 2. Furthermore, explanation forms in the lens holddown member 2 
through-hole 2A ( drawing 3 and drawing 4 nine places) with screw section 2a in which screw section lc of case la 
screwed. And by making screw section lc of case la screw in screw section 2a of through-hole 2A, each optical len 
1 is positioned by the lens holddown member 2, and can be attached. 

[0042] the field side where the lens holddown member 2 in which the optical lens 1 was attached counters -- a frame 
like spacer - the rectangle-like holddown member 4 is arranged through the member 7 An image pck-up side is 
located on the optical axis 9 which separated only the focal distance from each optical lens 1 attached in the lens 
holddown member 2, and the image pck-up element 12 is attached in the holddown member 4. the state where the 
optical axis between each optical lens 1 and each image pck-up element 12 to which a holddown member 4 
corresponds was adjusted - it is - fixed meanses, such as a screw, - a spacer - it is fixed to the lens holddown 
member 2 through a member 7 Thereby, the image pck-up light of the external world passes along each optical lens 
focusing on an optical axis 9, and is exposed on the image pck-up side of the image pck-up element 12 correspondin 
to each optical lens 1. 

[0043] a spacer -- it is infixed with predetermined thickness between the lens holddown member 2 and the holddow 
member 4 in order to secure the mounting space of the parts of the digital disposal circuit of the image pck-up 
element 12 or the circumference while a member 7 takes the interval of the focal distance of an optical lens 1 and th 
image pck-up element 12 in addition, a spacer -- you may form a member 7 in a holddown member 4 in the shape o 
frame at one 

[0044] Thus, two or more lens lb can be easily attached in the form which fixed the arrangement relation of each le 
lb by using the lens fittings (lens holddown member 2) which consist of one member, especially - the lens of the 
form of this operation - since it is unified by one member, the member 2 is replacing two or more lens fittings whic 
were need conventionally with one parts For this reason, splicing-machine styles, such as the number of the screw f 
installation and a screw hole, can be lessened, the man day and part mark of installation are reduced, and the parts 
itself can be fabricated in an easy configuration. Furthermore, since the parts of the screw of excessive installation 
were lost, the interval of a lens can be packed and arranged and the configuration as the whole multi-eye picture 
sensor can be made small. 

[0045] (Gestalt 2 of operation) The lens or compound lens in invention according to claim 2 is not used, but here 
explains the gestalt of the operation which achieves the function of a lens at a pinhole. Although drawing 5 is almos 
the same as the composition of the multi-eye picture sensor of drawing 4 , the pinhole lens 8 is the example formed 
the lens holddown member 2 as an optical condensing means of each camera instead of the usual optical lens 1. 
[0046] Although what is necessary is just for the pinhole lens 8 to be easiest lens and to make a small hole in the len 
holddown member 2, transparent plastics is usually inserted in the front face for dripproof ******. If the unit price 
one piece is used as many eyes even if it is cheap, the price of a lens is proportional to a part for the number of the 
camera to be used. With the gestalt of this operation, since it replaces with the optical lens 1 fixed to case la and the 
pinhole lens 8 is used, it contributes to reduction of the price of a multi-eye picture sensor. Furthermore, part mark a 
cut down and it becomes it is cheap, and processing is easy and possible to constitute a smaller multi-eye picture 
sensor. 

[0047] (Gestalt 3 of operation) Here, the gestalt of the operation which covers the light of portions other than the 
multi-eye picture sensor in a claim 3 and invention according to claim 4 which used the Fresnel lens, and a Fresnel 
lens is stated. Drawing 6 uses the member which has light-transmission nature for the lens holddown member 2, it 
processes the lens holddown member 2 so that the function of a lens may be achieved optically, it replaces it with an 
optical lens 1, and forms Fresnel lens 10 in the lens holddown member 2. 

[0048] Although drawing 6 shows only the lens holddown member 2 by which Fresnel lens 10 was formed in nine 
places, as for the composition of the whole multi-eye picture sensor, the parts of the lens in the lens holddown 
member 2 only differ, it is the same composition as drawing 4 or drawing 5 , and the light of the external world is 
received by the image pck-up element 12 through Fresnel lens 10. The lens holddown member 2 of drawing 6 is a 
member of light-transmission nature, and the light of other cameras and the light of the external world which is not 
meant will turn around it to a certain camera. Then, in the lens holddown member 2 which has light-transmission 
nature, portions other than Fresnel lens 10 are covered by the paint and member which do not make light penetrate. 
The influence and interference of an excessive light whose intention it does not have as a picture sensor can be 
lessened by this, and only a required place can be operated as an optical lens. 

[0049] (Form 4 of operation) Here, the form of the operation to which it is made for the light of the external world 
from an optical lens not to affect the image pck-up side of the image pck-up element of other optical lenses using th 
shield which consists of a member which does not make light penetrate in invention according to claim 6 is stated. 
Drawing 7 arranges the shield 1 1 which covers the light of other cameras behind the lens holddown member 2. 
Moreover, with the composition of drawing 7 , portions other than Fresnel lens 10 are covered in the lens holddown 



member 2 by the paint and member which do not make light penetrate. 

[0050] In addition, although drawing 7 shows only the shield 1 1 which covers the lens holddown member 2 in whic 
Fresnel lens 10 was formed, and light, as for the composition of the whole multi-eye picture sensor, the portion of th 
lens in the lens holddown member 2 only differs from the existence of a shield 1 1, it is the same composition as 
drawing 4 or drawing 5 , and the light of the external world is received by the image pck-up element 12 through 
Fresnel lens 10. The light of the external world is incorporated only from each Fresnel lens 10 of the lens holddown 
member 2 in that case. Moreover, the incidence to the image pck-up element 12 corresponding to other Fresnel lens 
10 is covered by the shield 1 1, and the light of the external world incorporated from Fresnel lens 10 is received by 
only the corresponding image pck-up element 12. 

[0051] (Form 5 of operation) In order to picturize two or more pictures which can be set to invention according to 
claim 5 here, the form of the operation which share-izes one picture image pck-up element is explained. In addition, 
is the form of synthetic implementation of invention in which the form of implementation of invention of other claim 
other than invention according to claim 5 is also included here. Drawing 2 shows the notional structure which 
receives the light from two or more optical lenses for an image pck-up element and one image pck-up element of th 
circumference electronic circuitry 3. 

[0052] About share-ization of this image pck-up element, the form of more concrete operation is explained using 
drawing 8 . Drawing 8 shows the appearance and structure of the multi-eye picture sensor 1 5 which were one-chip- 
ized. All functions are carried in one package (it is the same as the package of the usual IC, and will be called a chip 
here) which miniaturized this multi-eye picture sensor very much. Here, that by which the pinhole lens 8 was forme 
in the lens holddown member 2 as two or more condensing meanses is used, moreover, the shield 1 1 which covers 
light so that the light of each camera may not affect other cameras - a spacer - it is attached in the member 6 The 
shield 1 1 has classified the image pck-up field into plurality so that the picture from two or more pinhole lenses 8 m 
be received by only the image pck-up side of the predetermined field on the optical axis of the pinhole lens 8, 
respectively. 

[0053] Here, the share-ized image pck-up element 12 is used in order to picturize the image of two or more cameras 
simultaneously, and it is attached in the holddown member 4. In the lens of each camera which consists of each 
pinhole lens 8, and the light of the external world is received by one share-ized image pck-up element 12. As an 
image pck-up element 12, solid-state image pickup devices, such as CCD or MOS, are assumed. As these fixed ima 
pickup devices, the high resolving image pickup device of 1000 pixels or more of horizontals can be used now. 
Therefore, which camera using where and the place which determines beforehand and receives light can be share-iz 
two-dimensional on an image pck-up side. 

[0054] And the image of two or more cameras is picturized by one image pck-up element 12. Thus, though one ima 
pck-up element is share-ized, if the information on the parallax in each camera is detectable, processing of a multi-e 
stereo can be performed satisfactory. For example, if division processing of a picture as shown in processing of the 
multi-eye stereo of drawing 9 is performed as pretreatment, the rest will become the same as processing of the usual 
multi-eye stereo. 

[0055] Drawing 9 is explained in detail to a slight degree. Here, it is the multi-eye picture sensor of nine eyes, and th 
case where the image of nine cameras is simultaneously picturized with one share-ized image pck-up element is 
considered. In this case, from a multi-eye picture sensor, as one video signal (since there is also a case of a digital 
camera, you may be a digital signal at this time) of a raster scan, A/D conversion (it is unnecessary when an input is 
digital signal) of the picture of nine cameras is carried out, and it controls from the line number of a raster scan, or t 
information on a pixel position, and it performs division processing of a picture so that the picture of each camera 
may be taken out after this. The picture by which division processing was carried out is transmitted to the picture 
buffer of each camera, and processing as well as processing of the usual multi-eye stereo is performed by the back. 
[0056] That is, the candidate value di of the picture coordinate for calculation (I, J) and parallax is specified, and the 
lightness information on a correspondence candidate point is taken out from the picture buffer of each camera. If the 
degree of similar of the lightness of these correspondence candidate point groups is calculated, it will become the 
probability of the candidate value di of the parallax in the picture coordinate (I, J) specified by it. Usually, when 
calculating this degree of similar, the situation of correspondence near the picture coordinate (I, J) is also taken into 
consideration and calculated. Serially, the candidate value di of parallax can be changed and the probable parallax c 
be searched for. Moreover, the parallax about a full screen, i.e., a parallax picture, can be calculated by changing a 
picture coordinate (I, J) for this processing per 1 pixel. The parallax each point was presumed to be is easy 
calculation, and can be changed into the value of-like 3 -dimensional depth. 

[0057] With the gestalt of the above-mentioned implementation, when one image pck-up element was share-ized, it 
explained that the portion which is appropriately equivalent to the picture of each camera was extracted as a picture 
each camera, and processing of the same multi-eye stereo could do it the back. However, if a procedure is considere 



well, it is not necessary to necessarily divide into the picture of each camera. If the lightness of each correspondence 
candidate point can be extracted, as shown in drawing 10 , one buffer which saves the picture of all cameras can be 
prepared, and a multi-eye stereo can also be processed. In this case, since the lightness of the correspondence 
candidate point of each camera is read in order, although read-out time is taken, the number of picture buffers is one 
and there are few signal lines of the address of data or a picture coordinate sharply, and they can make hardware siz 
as the whole small. 
[0058] 

[Effect of the Invention] Since this invention is constituted as explained above, it does so an effect which is indicate 
below. 

[0059] As for the arrangement between two or more lenses, and the arrangement between a lens and an image pck-u 
element, in processing of a multi-eye stereo, if not fixed strictly, calculation becomes impossible. If it is the multi-ey 
picture sensor of invention according to claim 1, two or more small lenses are effectively fixable. Moreover, part 
mark decrease and the assembly of a multi-eye stereo also becomes easy. 

[0060] Since it is made to achieve the function of a lens at a pinhole, the multi-eye pixel sensor of invention 
according to claim 2 cuts down part mark, is cheap and effective in processing becoming easy. 
[0061] Since the multi-eye picture sensor of invention according to claim 3 processes the lens fittings of light- 
transmission nature itself like a Fresnel lens and it is made to achieve the function of a lens, it raises the flexibility o 
the form of a multi-eye picture sensor, and has the effect made to simple structure. 

[0062] The multi-eye pixel sensor of claim 4 publication or invention according to claim 6 can lessen the influence 
and interference of an excessive light whose intention it does not have as a picture sensor, and is effective in the 
ability to process an original multi-eye stereo efficiently correctly. 

[0063] The multi-eye picture sensor of invention according to claim 5 has the effect which cuts down part mark and 
can be realized as small and cheap equipment in order to share-ize one picture image pck-up element. 
[0064] Moreover, in order to acquire a multi-eye picture using the same picture image pck-up element, the property 
a picture sensor and the variation of sensitivity which pose a problem by the stereo image processing are lost, if the 
variation in the sensitivity of a picture sensor decreases, it will be markedly alike, corresponding-points detection w 
become easy, and measurement precision, such as distance, will improve Furthermore, since the video signal (analo 
signal) acquired with one picture image pck-up element is usually convertible for a digital signal by one A/D 
converter, it can also make the property of A/D conversion the same by the picture of many eyes. Naturally, the 
number of signal lines for transmitting a signal is the same as one camera, and can do the cable which is needed as t 
whole stereo image processing system, and connectors few. 
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